Exploring network dynamics with a mathematical triple jump 
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In the investigation of network dynamics a prominent role is played by analytical coarse-graining 
schemes. A powerful class of these schemes are the so-called heterogeneous approximations, which 
describe the dynamics of an agent-based network model by an infinite-dimensional system of dif- 
ferential equations. Here, we propose a widely applicable method for solving these systems, and 
illustrate it in the example of the adaptive voter model. 



In the triple jump an athlete attempts to cross a dis- 
tance by a sequence of three jumps: hop, step, and jump, 
that each employ different techniques. Here, we address 
the challenge of analyzing a dynamical network model 
with a mathematical triple jump. First using a hetero- 
geneous moment expansion we approximate an agent- 
based model by a high-dimensional system of ordinary 
differential equations (ODEs). Then, using generating 
functions we convert the high-dimensional ODEs into a 
low-dimensional system of partial differential equations 
(PDEs). Finally, using the method of characteristics we 
convert the PDE into a low-dimensional set of ODEs that 
can be solved analytically. 

In the mathematical exploration of a network model, 
finding a suitable approach that yields mathematically 
tractable equations is often a central challenge. One 
prominent method for approximating network dynam- 
ics are moment expansions [1-6]. The central idea is 
to write evolution equations for the abundance of cer- 
tain motifs in the network. Different expansions can be 
distinguished by the the basis of motifs that they use. 
The most basic type of approximation, the homogeneous 
mean-field approximations, only track the abundance of 
motifs consisting of single nodes, such that they yield 
equations describing, for example in epidemic spreading, 
the abundance of infected and susceptible agents. More 
sophisticated approximations, such as the pair approx- 
imation [1-3] or triplet approximation [5, 6] track also 
the abundance of larger motifs, such as linked pairs or 
triplets of nodes. 

A powerful class of approximations that have been re- 
cently proposed [7-10] are the heterogeneous approxima- 
tions. In these approximations the definition of a certain 
motif prescribes not only the state and connectivity of the 
network nodes in the motif, but also their outgoing links. 
For instance in the epidemic context one distinct mo- 
tif could be a susceptible node connected to exactly two 
other susceptible nodes and exactly one infected node. 

Heterogeneous approximations have been shown to 
yield excellent results in examples. However, they typ- 
ically lead to infinite dimensional systems of ODEs. In 
practice, the number of equations is limited by a trun- 
cation, but the number of ODEs that are studied is still 
often of the order of 10^. They are thus typically studied 



by numerical integration of these high-dimensional ODE 
systems. 

Here, we use generating functions to map the infinite- 
dimensional ODE system from a heterogeneous active 
neighborhood approximation to a PDE. While we make 
an approximation in the study of the present system this 
mapping is generally exact and reversible and thus does 
not involve additional assumptions. Generating func- 
tions are a major tool of discrete mathematics and as such 
have been applied to network problems. However, they 
are typically used to capture the structure rather than 
the dynamics of networks [11]. For the present context, 
relevant work includes [12] where generating functions 
were used to explore specific processes in the dynamics 
of an adaptive epidemic model. Here, we solve the PDE 
analytically by the method of characteristics [13]. The 
application of characteristics constitutes another exact 
reversible transformation, so that no additional approxi- 
mation is necessary. The triple jump approach can thus 
reveal full time-dependent solutions that describe the dy- 
namics of network to a high degree of accuracy. 

We illustrate the triple jump approach by considering 
the adaptive voter model [5, 7, 14-17]. This extension of 
the seminal voter model [18] has been studied with a wide 
variety of techniques [6] , and can thus be considered as a 
benchmark system. The model provides a "hard" exam- 
ple, where most approximations do not perform well [15]. 
In particular, it was already noted in [6] that this system 
is one of the rare cases where the heterogeneous approxi- 
mation does not perform particularly well. We therefore 
do not expect the results of this particular application of 
the triple jump methodology to yield a very close match 
with those of agent-based models. We have nevertheless 
chosen to focus on the adaptive voter model as it allows 
for a concise presentation of the methodology. 

Our main intention is to show that the systems of 
equations obtained from the heterogeneous approxima- 
tion can be solved analytically using generating functions 
and characteristics. We believe that this triple jump ap- 
proach will be valuable for the wide variety of models 
in which the heterogeneous approximation affords an al- 
most exact description of the system. 
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ADAPTIVE VOTER MODEL 

We consider a network of N nodes, representing agents, 
and K bidirectional links, representing social contacts. 
Each agent i, is associated with a binary variable G 
{A,B} representing the agent's opinion. We initialize 
the network of agents as an Erdos-Rcnyi random graph 
and assign opinions to the agents randomly with equal 
probability. The network is then evolved in time by con- 
secutive update steps. In each step a link connecting two 
agents i and j is selected randomly. If the agents hold 
identical opinions, Si = Sj, then the link is said to be 
inert and nothing happens. If Si ^ Sj, then the link is 
said to be active and one agent, a € is chosen with 

probability 1/2 to resolve the conflict. With probability 
p, the link connecting i and j is cut and a establishes a 
new link to a randomly chosen agent, k with Sk = So- 
Otherwise, with probability 1 — p, agent a changes its 
opinion such that Sj = Sj. We say that in the former 
case the conflict is resolved by a rewiring event, and in 
the latter case by an opinion adoption event. 

One can verify that the rules of the adaptive voter 
model are unbiased, such that there is no net drift in the 
number of nodes holding a particular opinion. Thus, the 
fraction of nodes holding opinion A, remains constant in 
time except for stochastic fluctuations that become negli- 
gible in the thermodynamic limit N ^ oo (with constant 
K/N). For simplicity, we can thus focus on the symmet- 
ric case where the number of nodes holding opinions A 
and B are equal. 



HOP: HETEROGENEOUS MOMENT 
EXPANSION 

In the first step, we convert the stochastic agent-based 
model into an infinite-dimensional system of ordinary dif- 
ferential equations (ODEs) by a heterogeneous expan- 
sion, known as the active neighborhood approximation. 
Following [9] we define A^^i to be the normalized number 
of agents of opinion A who have I active and and k inert 
links. In the thermodynamic limit we can treat the A^^i 
as continuous variables and capture their dynamics by 
the differential equations 
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where p = {1 — p). The terms in Eq. (1) describe the 

change experienced by a focal node Ak^i due to opinion 
adoption ((i) to (iv)) and rewiring ((v) to (vii)) events. 
Specifically, contributions arise from (i) adopting the 
opinion of a neighbor of type B, (ii) a neighbor of type 
B adopting the opinion of the focal node, (iii) a neighbor 
of type B adopting the opinion of another node of type 
A, (iv) a neighbor of type A adopting the opinion of an- 
other node of type B, (v) the focal node rewiring one of 
its links away from a neighbor of type B (acquiring a new 
neighbor of type A), (vi) a neighbor of type B rewiring a 
link away from the focal node, and (vii) a node of type 
A rewiring one of its links to the focal node. 

The events (iii), (iv), and (vii) involve nodes outside 
the direct neighborhood of the focal node. They are 
thus dependent on the number of next-nearest neighbors 
(iii, iv) or active links existing elsewhere (vii). The cor- 
responding rates then depend on longer-ranged correla- 
tions that are not captured by the Ak,i alone. We there- 
fore need to estimate these rates based on the available 
information from the nearest-neighbor correlations cap- 
tured. This approximation is called moment closure, and 
is known to be the main source of inaccuracy in moment 
expansions for networks [6]. 

For instance, the rate (iv) at which a typical neigh- 
bor of type A (A-ncighbor) of the focal node adopts 
the opinion B depends on the average number of B- 
neighbors of the A-neighbor, and thus on the next- 
nearest-neighborhood of the focal node. To approximate 
this number, one considers all potential A-neighbors, 
based on the known distribution Ak,i, but takes into ac- 
count that a node that has k links to other A-nodes is k 
times more likely to be an A-neighbor of the focal node. 
The distribution of A-neighbors of the focal node is thus 
kAk,i/ (E kAk.i), where the denominator arises from nor- 
malization. Based on this distribution we can then esti- 
mate the number of B-neighbors of a typical A-neighbor 
of the focal node as (^ IkAk.i) / (E ^Ak.i), which appears 
as a factor in the corresponding term (iv). Finally, to es- 
timate the typical density of A-neighbors of a B-neighbor 
of the focal node we exploit the symmetry of the system, 
which implies Ak^i = Bk^i- 

Motivated by results on the voter model using homo- 
geneous approximations, we assume that the two terms 
of type (i) cancel. We note that for the heterogeneous 
model, this approximation does not hold exactly. The 
approximation is made to avoid the appearance of non- 
local terms that complicate the solution of the PDE. In 
the present example they arise because we are exploiting 
the symmetry of the system to reduce dimensionality. In 
the general case, one would have to deal with a higher 
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dimensional PDE, but the approximation would not be 
necessary. 

STEP: GENERATING FUNCTIONS 

The heterogeneous expansion results in an infinite 
system of ODEs, which we transform into a single 
scalar PDE by use of generating functions [19]. We 
start by defining the generating function Q{x,y,t) = 
X^fe ; ^k,i{t)x'^y'' , where x and y are abstract spatial vari- 
ables that do not have any physical interpretation. 

The time evolution of Q is given by 
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Substituting Eq. (1) into this expression results in a num- 
ber of terms on the right-hand-side that can be inter- 
preted as functions of Q and its derivatives, for which we 
use the notation Qx = dQ/dx. For instance, the process 
(ii) described above results in a term proportional to 

[{I + l)Ak-i,i+i - lAh,i] x^y^ = xQy - yQy, (3) 

k,l 

where we separated the two terms in the square bracket 
and used a shift of indices k — l^k, l + l^lou the 
first. Proceeding analogously, we find that Q satisfies 
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are the transformed factors from the moment closure ap- 
proximation. These factors arc unknown, but can be 
found by demanding self-consistency. Similarly, trans- 
forming the initial condition yields, at t = 0, Q = e^ 
with^= {k){x + y -2)/2. 



JUMP: CHARACTERISTICS 

The generating function PDE (4) is a first-order scalar 
quasilinear equation, of the form 

^aj(a;i, . . .,Xm,u)— = c{xi, . . ■,Xm,u) (6) 



i=l 



Such PDEs can be solved by the method of characteris- 
tics [13]. The central idea of this method is to describe 
the solution surface parametrically, and hence capture 



the dynamics with a low-dimensional set of ODEs in 
{xi, . . . ,Xm,u)-spa,ce: the bicharacteristic equations 
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with the initial condition u = Uo(^i, . . . , ^m-i), Xi = 
Xioi^i, ■ ■ • at 77 = 770. 

The bicharacteristic equations for Eq. (4) are 
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with t = 0, a; = Ci, y = 6, Q = cxp{(fc) (Ci +6-2) /2} 
at 77 = 0. For simplicity, we assume that a, /3, 7 are 
constant; while this may not be true in general, it is true 
close to stationary states, as the longer-ranged correla- 
tions in adaptive networks equilibrate in general faster 
than shorter-ranged ones. Solving Eqs. (8)-(ll) we find 

= exp|^(6+6-2) 



PI 
2|A| 



Ai 



(e^i* -1) 



+ 



A2 



(e^=* -1) 



(12) 



where Ai,2 and arc eigcnvahies and eigenvector com- 
ponents of the homogeneous linear operator defined by 
Eqs. (9) and (10), which relate {x,y) to (^i,6)- 

Figs. 1 and 2 show the analytic solution, Eq. (12), com- 
pared with numerical integration of the high-dimensional 
ODE system, Eq. (1). They illustrate the well-known dy- 
namics of the adaptive voter model. If the rewiring rate 
p is sufficiently low then the system approaches an ac- 
tive state that is stable in the thermodynamic limit [7]. 
If the rewiring rate exceeds a threshold however, the 
system rapidly approaches a fragmented state, where the 
network breaks into two disconnected components that 
hold different opinions, but are internally in consensus. 
Further, the figures show that the analytic and numeric 
results are in good agreement. The minor discrepancies 
are likely due to finite cut-off in the numerics, and (in 
Fig. 1) due to the assumption of constant a, /3, and 7. 

Two conclusions can immediately be drawn from the 
analytic solution Eq. (12). First, the consistency con- 
ditions Eq. (5) imply that a = /3 = 7. This is in- 
teresting because it shows that correlations beyond the 
nearest neighbors are not captured by the approxima- 
tion, i.e. the probability of finding an active link attached 
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FIG. 1. (Color Online) Timeseries. Number of active links 7 
as a function of time t, for different rewiring rates p. Shown is 
a comparison of numerical integration of the high-dimensional 
ODE (left) and triple jump analytic solution (right). 




FIG. 2. (Color Online) Fragmentation transition. Shown are 
number of active links 7 as a function of the rewiring rate 
p (left), and critical rewiring rate pc as a function of mean 
degree k. Both exhibit a good agreement between numerical 
(points) and analytic solutions (lines). 



to a node is independent of the other neighbors of the 
node. This failure to capture longer-ranged correlations 
was aheady suspected to be the main source of error in 
the heterogeneous approximation of the adaptive voter 
model in [6]. Second, we can analytically determine 
the critical rewiring rate, pc- As t ^ 00, Qx (1, 1) — 
7-I- (1 +p)/{l —p), and by definition Qy{l, 1) = 7. Sub- 
stituting these results into Qx{l,l) + Qy{l,l) = {k) gives 
a = /3 = 7 = [{k) - {l+p)/{l -p)] /2. At the fragmen- 
tation transition the active links vanish, thus 7 = and 
Pc — {{k) — l)/{{k) + l). Because the longer-ranged corre- 
lations are not captured this result is only qualitatively 
correct. However, it performs better than simpler ap- 
proximations [6], with the exception of [15] which is only 
applicable close to the fragmentation point. 



CONCLUSIONS 

In this paper we have proposed an approach for the in- 
vestigation of network dynamics that combines heteroge- 
neous expansions, generating functions, and the method 
of characteristics. Using this mathematical triple jump, 
analytic solutions for heterogeneous expansions can be 
obtained, which we demonstrated on the example of the 
adaptive voter model. 

For the adaptive voter model studied here, it is known 
that this provides only qualitative results [6]. However, 
heterogeneous expansions provide an excellent approx- 
imation in other models [9, 10]. Here, we focused on 
the adaptive voter model because its symmetry allows 
for a concise presentation of the triple jump methodol- 
ogy. When applying the approach to other models it will 
be necessary to write equations for multiple states. One 
generally has the choice between representing states as 
a variable (i?i.j in addition to Aij, say), or as an ex- 
tra index {Aij,k instead of Ai,j). The latter choice may 
be advantageous as it leads to a single scalar PDE in a 
three-dimensional space, rather than two coupled PDEs 
in a two-dimensional space. We note that unless sym- 
metry is exploited to reduce dimensionality, the result- 
ing PDE is local, and thus the additional approximation 
that we made above (cancelation of termsof type i) is 
not necessary. Thus triple jump approach generally does 
not involve assumptions, other than those inherent in the 
heterogeneous expansion. 

Depending on the system the method of characteris- 
tics may not be appropriate, for the final step of the 
triple jump. However, in any case this step profits from 
well-developed PDE theory, such that analytic solutions 
should in many cases be possible. 
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